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Abstract 


ANGL/ JHARTl is a Machine Aided Translation System from English to Indian Languages. 
This w rk deals with system design aspect of ANGLAB HARTI, with specific reference to English 
to Tar: 1 translation. 

ANGLAB HARTI exploits the commonality among Indian Languages to obtarn a pseudo- 
intermetliate representation from English. The computational effort in arriving at this pseudo 
intermediate representation is kept minimal. This makes the system more practical. The 
system envisages the use of human assistance to improve the quality of translation. 

TIu! structural transformation is taken care of by storing prominent patterns in English 
and 1 Jteir associated transformations in the target languages, using a grammar. 

'] lie semantic disambiguation is made variously using patterns, syntactic attributes and 

sele< i ional restrictions, enforced by semantic tags. 

All the text generators for various target languages use the same intermediate outp 
generated by the preceding stages of ANGLABHARTI. This way a generic translation sy 
for Indian Languages is obtained. 
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Chapter 1 


Overview of ANGLABHARTI 

1.1 On Machine Translation 

The task of MT can be defined very simply: the computer must be able to obtain as input 
a text in one language (SL, for source language) and produce as output a text in another 
language (TL, for target language), so that the meaning of the TL text is the same as that of 
the SL text [31]. This leads to a number of questions: 

1. What is the meaning of the text? 

2. Does it have any component structure? 

3. How does one represent the meaning of a text? 

4. How does one set out to extract the meaning of a text? 

5. Is it absolutely necessary to extract meaning in order to translate? 

All the above problems are difficult. Multiple senses lead to the problem of disambiguation. 
A significant amount of semantic and pragmatic analysis of natural language is required before 
the disambiguation can be achieved. 

There are two major avenues of circumventing the problem of completely automatic disam- 
biguation. First, one can restrict the grammar and the vocabulary of the input text in such a 
way that most of the ambiguity is eliminated. This is the sublanguage, or subworld, approach 
to MT. Second, one can drop the requirement of complete automation and allow humans to 
get involved in the translation process. This is Machine-Aided Dcanslation approach. The 
difference between these approaches is not only in the tactics of interspersing automated and 



3 


manual steps in the process of translation, but also in the nature of the subtasks for which 
humans are responsible. 

ANGLABHARTI falls under the second category. 

1.2 On Human Interaction in Machine- Aided Translation 

With respect to the strategy of human involvement in MAT, there are three possibilities: pre- 
editing, post-editing and interactive editing. A human pre-editor reads the input text and 
modifies it in such a way that the MT system is able to process it automatically. Difficult 
and overly ambiguous words and phrases are replaced with those that the editor knows the 
program will handle. A human post-editor, conversely, obtains the output from an MT system 
and eliminates all inaccuracies and errors in it. An interactive editor engages in a dialc^ with 
the MT system, in which the human resolves ambiguities that the machine is not capable of 
resolving itself. It is, of course, necessary to build a special interface to maintain this kind of 
dialog. 

ANGLABHARTI employs post-editing predominantly, and to a lesser extent, interactive- 
editing. 

Further information on human-machine interaction in translation may be obtained from 
129]. 


1.3 Strategies in Machine (Aided) Translation 

Three major strategies have governed the design on MT systems over the last two decades 
[40], viz. Direct Translation strategy. Transfer strategy and interlingua strategy. 

The direct translation system is designed, from its outset, for a specific source and target 
language pair. No general linguistic theory or parsing principles are necessarily present for 
direct translation to work; these systems depend instead on well-developed dictionaries, mor- 
phological analysis, and text processing software to gain credible translations of the source text 
into a series of reasonably equivalent words and phrases in the target language. SYSTRAN 
system [38] is an example. 

In the transfer strategy, a source language (SL) sentence is first parsed into an abstract 
internal (usually, some sort of annotated structure) representation. Thereafter, a ‘transfer’ 
is made at both the lexical and structural levels into corresponding structures in the target 



4 


language (TL). In the third stage, the translation is generated. Three dictionaries are needed 
for transfer: an SL dictionary, a bilingual transfer dictionary, and a TL dictionary. The level 
of transfer differs from system to system - the representation varies from purely syntactic deep 
structure markers to syntactico-semantic (compositional semantics, case frame information, 
and so forth) annotated trees. Note that the transfer stage involves a bilingual component, 

i.e. one tailored for a specific SL-TL pair. This strategy was popularised by system like SUSY 

[ 26 ]. 

An alternative approach is to develop a universal, language-independent representation for 
text, known as interlingua.. Here the MT model has two phases: analysis and generation. In 
principle, we can dispense with bilinguality. For a multilingual system with n SLs and m TLs 
the transfer approach will require mn transfer blocks (if the sets of SLs and TLs are disjoint), 
in addition to n analyzers and m generators. In the interlingua approach, only n parsers and 
m generators will be needed. This uses the AI approach. 

The strategy in ANGLABHARTI is better than the transfer approach, as the translation is 
valid for a host of TLs, but falls short of a genuine interlingua, in that it ignores the meaning 
of the text to be translated. 

1.4 Design Objectives 

1. The primary motive of this system is to exploit the closeness exhibited by the family of 
Indian languages. A simple paradigm is devised which is good enough to translate from 
English to an intermediate form, using which different target text generators construct 
the translated output in Indian languages. 

2. The unit of translation is a sentence. No attempt is made to incorporate intersentential 
context. 

3. The system is not guaranteed to produce 100% perfect translation all the time. A human 
postediting after the machine translation is not ruled out. The approach is based on 
heuristics, using A.I. techniques. 

4. Translation with minimal understanding of the text. Many of the MT systems have 
proved to be not viable for general purpose translation, simply because they require a 
deeper analysis of the sentence. The present approach requires simpler processing of 
the given sentence in' English. In fact, the paradigm involves transferring the surface 




Figure 1.1: Block Schemata of ANGLABHARTI 
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structure from English to that in Indian languages, without penetrating into the deep 
structure [1 1] of the sentence. 

1.5 System Components 

The following are the major components of ANGLABHARTI:- 

1. Rule base. This contains rules for mapping structures of sentence from English to Indian 
languages. This database of pattern-transformations from English to Indian languages 
is entrusted the job of making a surface-tree to surface-tree translation, bypassing the 
task of getting a deep tree of the sentence to be translated. 

2. Sense disambiguator. This module is responsible for the picking of the correct sense of 
each word in the source language. It should be of interest to note that sense disambigua- 
tion is done for only the source text. 

The approach used in ANGLABHARTI may be termed rule-by-rule semantic interpreta- 
tion [2, 3]. Here the semantic interpreter is called each time a syntactic rule is applied. 

3. Target text generators. These form the tail ends of the system. Their function is to 
generate the translated output for the corresponding target languages. They taJce as 
input the intermediate form generated by the previous stages of ANGLABHARTI. Note 
that their task is quite different from what is called Natural Language Generation [13], 
in that the latter has also to decide ‘what to say’ (the strategic level) in addition to ‘how 
to say it’ (the tactical level). 

Note that by having different text generators using the same rule base and sense disam- 
biguator, a generic MT system is obtained for a host of target languages. 

4. Multi-lingual dictionary. This contains various details for each word in English, like their 
syntactic categories, possible senses, keys to disambiguate their senses, corresponding 
words in target languages. 

5. Rule base Acquirer. This prepares the rule base for the MT system. This module involves 
a suitable Machine Learning paradigm. 

Figure 1.1 shows the interaction among the components mentioned. 

A similar Machine Translation System using structural transformation, followed by sense 
disambiguation between English and Japanese is the Mu-Project [39]. 
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1.6 Rule Base 

English is a verb-central language, whereas the Indian languages may be treated as verb-final 
ones. Some of the characteristics of verb-final languages include: [27] 

1. Verb is typically the last word, 
eg. avan kadaikku chenrAn 

he shop -to go 
■ he went to the shop 

2. Postpositions after nouns, eg. magan -ikkAga ( son -for) 

3. Modifiers precede the head noun. 

4. Auxiliaries follow main verb. 

A set of pattern directed rules is constructed, which transforms the surface structure of the 
sentence in English to an intermediate form. 

A typical movement rule is: 

noun-phrase verb-phrase prep-phrase — *• noun-phrase' prep-phrase' verb-phrase' 
eg. I am going to the market — »■ intermediateJbrm 

intermediateJorm = [noun, dont_care, singular ,first,(HUMAN ,ANIMATE),I,nAn,main], 

[noun,neuter,singulai,third,(PLACE),market,kadai,bazAr], 

(pr€p,to),[am_verb_5,go,(pO,pO),(jAoA)] 

This is used by the Text generators to output: 

(Tamil) nAn mArkettukku pOgirEn 
(Hindi) main bAzAr jAjrahAJhUng 

Such movement rules are identified to construct rule base. The construction of rule base 
in ANGLABHARTl was done after analysing the possible patterns in English of oft occurrence 
[1, 18, 33, 34 , 44]. 

The idea of using structural transformations in MT is quite common. Makoto s system[30] 
uses similar ideas to translate between English and Japanese. 
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1.7 Sense Disambiguation 

The ambiguity resolution is predominantly carried out using semantic tags. Detailed discussion 
on the mechanism used can be found in subsequent chapters. 

1.8 Dictionciry Organisation 

A two-tier organisation of lexicon is suggested. The external lexicon has the standard informar 
tion about the words. The “‘on-line lexicon” has information about only the words currently 
encountered in the source sentence. This scheme helps in simplifying details of the parser used 
for movement rules. Typically root words are stored in the external lexicon, whereas the full 
form of the word is put in the on-line lexicon. 

Elaborate details about the storage of idioms and phrases are also considered to provide a 
general purpose translation. 

1.9 Text generation 

The different text generators for Hindi, Tamil, and Telugu use information like the morphology 
of root words, special properties of categories and other related details necessary for the indi- 
vidual target language. It is of interest to note that even in this last stage of ANGLAB MARTI 
considerable similarity is exhibited in the working of different text generators. 

Elaborate discussion of Tamil Text Generator can be found subsequently. 



Chapter 2 

Movement Rules 


2.1 Movement Rules 

The idea of using surface patterns to capture the meaning of sentences is quite old in linguistics 
[17]. Although simple, this scheme is effective in capturing the idiosyncrasies of the surface 
patterns of a language. 

The phrase structure grammar of Chomsky [8] and the c-structure of lexical-functional 
grammar [20] has a lot in common with the approach used in A IMG LAB MARTI. 

The database of structural transformation rules from English to Indian languages, hereafter 
referred to simply as rule base, forms the heart of ANGLABHARTl system. This takes care 
of the crucial changes in the syntax while translating from English. As mentioned earlier, by 
making a generic rule base for Indian languages, ANGLABHARTl exhibits a potential benefit 
while translating from English. 

The subsequent sections discuss the various concepts regarding the rule base. 

2.2 Components of rule base 

The following are the major components of rule base: 

• Phrases. Typical word units like noun-phrase, verb-phrase and prep-phrase. 

• Case markers. These are the units that express an implicit semantic relationship in 
English pattern, which however has to be explicitly denoted in Tamil. 

eg. poun-phrase-1 verb-phrase noun-phrase-2 — > noun- phrase- 1' noun-phrase- 2' kl 

verb-phrase' 

I called her —>■ nAn aval -ai kUppittEn 
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Here kl is mapped to the Tamil suffix ‘-ai’, denoting that noun-phrase-2 serves as an 
object to verb-phrase. 

• Literals. There may be literals in the movement rules of rule base. They are to be 
interpreted by the target text generators accordingly. 

eg. sentence- 1 and sentence-2 — ♦ sentence- 1' 11 sentence-2' 

Here 11 is a literal interpreted as ‘matrum’ by Tamil text generator and ‘Owr’ by Hindi 
text generator. This helps in constructing a generic rule base. 

• Parameter mechanism. When the word units are moved, the other units with which 
they are associated has to be specified. For instance, when verb-phrase is moved, its 
parameters like tense, modality and the noun- phrase to be used for gender-number- 
person (gnp) agreement are specified as parameters to the verb-phrase mapper. 

• Macros. In order to enable the use of the same rule base for translation into a variety of 
Indian languages, the idea of macros is introduced. 

eg. noun-phrase whose sent- 1 rest-of-sent — whose(noun-phrase,sent-l) rest-of-sent' 

Here whose() is a macro that specifies how its parameters are to be modified according 
to the specific target language. Such macros are embedded in target text generators. 

Consider the noun phrase: the lady whose bag was stolen, which is parsed as whose(noun- 
phrase(the lady), sent-l(bag was stolen)). Now the Tamil text generator expands this 
as: 


enda noun-phrase'(the lady) -udaiya sent-l'(bag was stolen) -0 anda noun-phrase'(the 

lady) 

whereas the Hindi text generator expands this as: 


jis noun-phrase'(the lady) -kA_form sent-l'(bag was stolen) vus noun-phrase'(the lady) 
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2.3 Organisation of rule base 

Due to the large rule base necessary for any decent translation, the efficiency of the parser 
suffers. Hence the rule base must be organised suitably. 

The following gives a guideline to how the rule base is organised: 

• Each rule has a pattern occurring in English and a corresponding pattern in Indian 
Languages, expressed in terms of the components in English pattern. 

• The rule base itself is hierarchically structured. There are separate rule ba^es for noun- 
phraises, verb-phrases, prep- phrases etc. In addition, there is a rule base for sentences 
that are expressed in terms of the other lower level rule bases. This is because the 
movements within the individual phrases during transformation is largely independent 
of the surrounding word-units. 

Suppose there is a pattern ‘det-star adj-star noun’ for noun-phrases. This pattern is 
translated in Tamil as ‘det-star adj-star noun’ independent of the other components of 
the sentence with this noun-phrase. 

Thus by using this hierarchy of rule base, the number of sentence-patterns is effectively 
reduced. Where such independent transformations within a hierarchy is not possible (for 
instance, when a noun-phrase cannot be transformed independent of its relative clause, 
and the target language for translation), one can use the facility of literals and macros 
within the rule base, as explained already. 

• Only the English patterns for simple sentences are captured in rule base. All other varia- 
tions are expressed in terms of the existing rule base for simple sentences and individual 
phrases. This further reduces the size of rule base. This is in tune with Chomsky’s view 
18] ‘^-the grammar of English is materially simplified if phrase structure description is 
limited to a kernel of simple sentences from which all other sentences are constructed by 
repeated transformation”. 

• Where it is convenient to use a special form of an existing pattern, it is entered in rule 
base separately. 

For instance, it is convenient to treat ‘noun- phrase- 1 is noun-phrase-2’ pattern as distinct 
from ‘noun-phrase- 1 verb-phrase noun-phrase-2’ pattern, as the latter typically requires 
a case marker in the corresponding target pattern. 
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• Slight deviation of an English pattern is taken care by making use of the existing rule 
base differently, according the need. 

Consider the noun-phrase pattern, ‘noun-phrase who slot’. Here ‘slot’ stands for a sen- 
tence pattern, excepting that the subject will be missing, as in ‘the girl who became 
angry’. It is prudent to use the existing rule base for such variations. ANGLABHARTI 
permits the same. 

2.4 Principle of operation 

The following are some of the features that enable the scheme mentioned to be effective. 

• There is a strong correlation between syntax and semantics in English. This enables one 
to ascertain the semantic role of a word unit from the syntax of the sentence. For example, 
the surface pattern ‘noun-phrase- 1 verb-phrase noun-phrase-2’ can be interpreted to mean 
‘subject action object’. This means the case relationship can be identified from the 
pattern itself. 

Note that this view is quite familiar in linguistics. Chomsky has repeatedly claimed 
[9, 10] that grammatical relations such as subject-of and object-of can be equated with 
configurational relations in the deep structure. 

• Among the Indian languages, similar grammatical properties can be identified. In par- 
ticular, while translating from English, the movement rules do not differ widely. This 
enables building a generic rule base, as mentioned earlier. 

• Due to the human engineering involved in constructing the rule base, the translation can 
be easily tailored to fit the styles of target languages. 

• In any MT system, two major components are involved: the movement of word units and 
the sense disambiguation of word units. Because a viable scheme for sense disambiguation 
with minimal understanding is identified (to be elaborated later), the above rule base 
technique can be adopted. 

• ANGLABHARTI ignores intersententiaJ context. Hence the structural transformation rule 
for an isolated sentence can be used. 

Now some specific trouble-shooters in this technique are identified, together with sugges- 
tions about overcoming them. 
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2.5 Rule base acquisition 

A major trouble with the above approach is in acquiring the rule base. Bnglish is a rich 
language with an enormous variety of patterns. Clearly, a universal set of patterns is yet to 
be identified. 

Hence the rale base cannot be static. It should be augmented by a module that acquires 
new rules, using a suitable machine learning paradigm. Different paradigms for acquiring such 
structural transformation rules can be obtained from [6]. 

It is of interest to note that acquisition of rule base from examples strongly resemble 
the projection problem [21]. A speaker's knowledge of his language takes the form of rules 
which project the finite set of sentence he has fortuitiously encountered to the infinite set 
of sentences of the language. A description of the language which adequately represent the 
speaker's linguistic knowledge must, accordingly, state these rules. The problem of formulating 
these rules is referred to as the projection problem. 

Alternatively, the rule base may be manually updated periodically depending on its perfor- 
mance, an approach currently followed in ANGLABHARTI. In the developmental stages, this is 
one of the best approaches possible. 

Clearly the perfect translation of any text is not feasible without involving a deep un- 
derstanding. The technique presented here is meant only to tackle the commonly used text 
formats. It is believed that the cost involved in any further refinement increases rapidly, and 
hence may not be worthwhile if a human engineering is envisaged for the post-editing of the 
translated output. 

2.6 Ambiguity resolution 

The use of pattern-matching technique leads to the problem of resolution in case of contentions. 
It is very likely that two or more patterns lit the given sentence. In tune with the spirit of 
minimal understanding, the resolution is carried out by studying the various conflicts and 
encoding the resolution in the rule base for each possible contention. 

For instance, consider the word ‘her’, ANGLABHARTI treats this both as a possessive case 
and as a noun. The ambiguity is resolved by taking it to be the former whenever it is followed 
by a noun, and as the latter, otherwise. 
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As an another example, consider the sentence “flying planes is dangerous”. Here the noun- 
phrase ‘flying planes’ fit the pattern ‘adjective noun’ as well as ‘gerund noun’. However, the 
rule base rejects the first pattern as it mismatches with the expectation of the verb ‘is’ in the 
sentence. 

2.7 Identification of case markers 

As explained already, some of the target patterns involve the identification of suitable case 
markers. For instance, 

noun-phrase- 1 verb-phrase noun-phrase-2 —*■ noun-phrase- 1' noun-phrase- 2^ kl verb-phrase' 

Here kl is a case marker which is to be identified for each target language by the corresponding 
text generator. However, the case marker kl for a given language cannot be fixed from the 
surface pattern itself. 

Dlustrating with examples for the target language Tamil, 

Rama called Sita — » Rama Sita -ai kUpittAn (kl: -ai) 

Rama went home -+ Rama vidu -ikku pOnAn (kl: -ikku) 

Currently work is underway in resolving the ambiguities in case marker mappings in target 
languages. 

2.8 Merits of the scheme 

In spite of being a shallow approach, the scheme merits some consideration. 

1. Resolution of parts of speech is avoided. In any MT system, it is imperative that the 
parts of speech of each word in the sentence be identified. Several words can function 
in multiple parts of speech, for instance ‘bark’ can be ‘noun’ or ‘verb’, the resolution of 
which requires inquiring into the role played by them. However by virtue of using surface 
templates, the parts of speech is fixed a priori. 

2. Simple implementation. A typical PROLOG based grammar system will do to realise 
the scheme presented. In fact, the current version of ANGLABHARTI uses prolog to 
realise the rule base mentioned. Using the powerful grammar writing system embedded 
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in QUINTUS-PROLOG [12,32], we have implemented over thirty such rules taking care 
of the commonly occurring sentence patterns. 

Various alternate parsing techniques for natural language grammar may be found in [3, 
23]. 

3. By making a surface structure to surface structure mapping, the tedious scheme of ex- 
tracting the deep structure, a technique by no means perfected as of now, is eliminated. 

4. Prom psycholinguistics, we infer that the frequency of use of different possible patterns 
differs. This means that even if all possible patterns are not captured, the common 
type of sentences can be translated, being limited only by the vocabulary present in the 
lexicon. 



Chapter 3 

Logical Design of Lexicon for 
ANGLABHARTI 


3.1 Lexical features 

A proper lexicon is a must for any MT activity. For the above system, the following gives a 
list of salient features required: 

• The lexicon should exploit the close relationship among the Indian languages. Some of 
the features exemplified by the family of Indian languages are: 

1. More often than not, any word in a given sense in a given language has its counter- 
part in any other language. Hence it is prudent to store in the lexicon, against a 
word in English in a particular sense, all its counterparts in the target languages. A 
separate bilingual lexicon for each target language exhibits considerable redundancy 
in the storage of English components. 

2. Further the lexicon, as preferred, may serve other purposes - MT among Indian 
Languages is a case in point. 

• Each word in English must be disambiguated with regards its senses. A lexicon is a 
valuable repository to store information for disambiguating word senses. 

• In addition to the words in target languages, details such as their morphological infor- 
mation, special grammatical properties may be stored. 

• Storage of phrases should be taken into account. It is suggested that phrases be treated 
as word clusters with regular parts of speech. This enables the parser to treat a single 
word and a phrase alike, while filling slots for a particular part of speech. 
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A special part of speech, ZERO is introduced for phrases, in case they cannot be classified 
rigidly as any of the regular part of speech. However, a ZERO phrase may be literally 
substituted in the target language, irrespective of the other units present in the source 
sentence. Thus ZERO phrases do not affect the regular parse. 

• Idioms require special consideration. While a literal substitution of idioms is good enough 
for MT, it is inefficient. A good lexicon allows the grammatical variations of idioms to 
be derived by morphological analysis. 

3.2 Lexical components 

The following components are identified for the lexicon design: 

1. The word in English with its grammatical properties. The grammatical properties of a 
word include its parts of speech and related attributes. 

2. Morphology of English word. Details to derive the morphological variations of the root 
word. For instance ‘eat’, ‘ate’, ‘eating’, ‘eaten’, ‘eats’ all may be derived from the root 
word ‘eat’. 

3. Semantic tags. These are cryptic semantic primitives for various senses of the word. 

4. Sense disambiguation rules. They are the encoded heuristics to identify the proper sense 
of a word. 

5. Roots in target languages, with related information. The gender of a word in English 
may differ from its counterpart in Hindi, although it is not so in Tamil. Such information 
must be available for the target text generator. In addition, morphological information 
for derivations from the roots must be provided. 

The lexicon suggested is organised as shown in Figure 3.1. 

3.3 Semantic tags 

As seen in the diagram, semantic tags are attached to each sense of a word. These tags are 
strings that provide a common sense classification for the sense involved. These are used by 
the sense disambiguation rules, to be discussed later. 
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In order to avoid loading each sense with several possible semantic primitives, a taxonomy 
of semantic primitives is designed. Thus if the tag reads ‘fruit’, tags like ‘inanimate’, ‘plant’ 
need not be stored. Therefore lexicon contains nodes in a directed graph of semantic tags, 
with ancestor nodes being inherited. 

The taxonomy construction involves the following stages: 

1. Formulation of disambiguation rules. First the heuristics for disambiguating senses of a 
word is formed. This is done off-line. 

2. Directed Acyclic graph construction (DAG). Now the semantic tags are identified and 
classified corresponding to their real-world relationship. 

3. Updating the DAG. As newer semantic tags are identified, they are inserted in the existing 
DAG. 

3.4 Sense disambiguation rules 

These are heuristics that enable disambiguation of senses for each word, which are then encoded 
in the lexicon. These rules make use of grammatical properties (transitivity /intransitivity etc.), 
patterns (to capture phrasal verbs), semantic tag (to enforce selectional restrictions) and so 
on. 

Elaborate discussion on disambiguation of verbs, prepositions and adjectives can be found 
in the subsequent chapters. 

3.5 off-line and on-line lexicons 

In order to take care of storage and efficiency considerations, the lexicon is organised in two 
parts. 

• off-line lexicon. This is the data structure containing the bilingual dictionary components 
for the entire vocabulary used by ANGLABHARTI. Here space is saved by storing all the 
categories and their related information for each root word together. Currently work is 
underway to organise it more efficiently as a database. 

• on-line lexicon. This is the primary data structure that drives ANGLABHARTI. Here 
organisation is based on category instead of root word. This means that all verbs are 
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together in a particular format, aJl nouns are clustered in another format and so on. In 
particular, if a word can function as a noun as well as a verb, it is repeated. 

Another salient feature of on-line lexicon is that the words here appear as they do in the 
input English sentence. Hence if two morphological derivations of a root word appear in 
the given sentence, it is stored twice. 

The most important feature, of course, is that it caters to the need of a single sentence 
at hand. As ANGLABHARTI ignores the intersentential context, the system has only 
information required to handle the current sentence to be translated. 

A morphological analyser for English prepares the on-line lexicon from the ofF-line lexicon. 
Performance may be improved by preparing the on-line lexicon for a bigger unit like a 
paragraph, instead of a sentence. 



Chapter 4 


Ambiguity Resolution in 
ANGLABHARTI 


4.1 Ambiguity 

In case there is a single word which tells why MT is difficult, it is ambiguity. In communication 
among humans, several implicit assumptions are available which help us to find the sense of 
any sentence uttered. However, in MT, elaborate mechanism must be designed to capture this 
knowledge. 

Several cases of ambiguity can be found in Graeme's work [19]. 

The following gives an idea of how the problem of ambiguity is being tackled by ANGLAB- 
HARTI. Whatever ambiguity is not resolved is left for human post-editing. 

4.2 Lexical Ambiguity 

There are three types of lexical ambiguity: 

• Polysemy. These are words whose several meanings are related to one another. For eg., 
the verb ‘open’ may mean ‘unfold’, ‘expand’, ‘reveal’ etc. 

• Homonymy. These are words whose meanings are unrelated. For eg., the noun ‘bark’ 
may mean ‘covering of a tree’ or ‘noise made by a dog’. 

• Categorical ambiguity. These are words whose syntactic category can vary. For eg., the 
word ‘sink’ may be a noun or a verb. 

ANGLABHARTI can tackle both homonymy and categorical ambiguity, as of now. Even 
typical ‘garden path’ sentences like “the old dog the footsteps of the young” will be correctly 
resolved to mean “the footsteps of the young axe dogged by the old people”. 
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4.3 Word Sense Disambiguation 

The meaning of a sentence and that of its words are closely related by the Principle of Com- 
positionality, which insists that the meanings of sentences( and other linguistic expressions 
consisting of more than one word, such as noun phrases) are understood in terms of the mean- 
ings of their component words, and, equivalently, the meanings of words are understood in 
terms of the contributions they make to the meanings of the sentences in which they occur 
[27]. 

The sense in which a word is used in the source sentence should be determined, in order 
that a suitable word in the target language be chosen. This is so because, as has been observed, 
different senses of a word maps onto different words in different languages. For example, the 
noun ‘bar’ in “the lawyer stopped at the bar for a drink” mean ‘a place where drinks are 
served’, rather than ‘a court room’. We use a set of syntactic and semantic tags with heuristic 
rules. This is found to disambiguate a majority of common usage situations. 

Typically word sense disambiguation needs; 

1. context knowledge. At times this can even mislead. A classic example where context 
knowledge can actually mislead disambiguation, instead of aiding it, is given by Cherniak 
[7]. In the sentence, “the astronomer married a star”, many people found it difficult to 
take ‘star’ for ‘a movie star’. 

2. local word grouping 

3. to handle syntactic disambiguation clues 

4. to handle selectional restrictions [4] 

5. inference, as a last resort 
ANGLABHARTI uses 2, 3 and 4. 

Selectional restrictions are implemented by the idea of semantic tags. 

4.4 semantic tags 

Semantic tags are keywords that denote the real world usage of a word. For eg., ‘programmer’ 
can have tags like ‘human’, ‘skilled-man’, ‘computer’ etc. The idea of semantic tags is pretty 
old. Aristotle gave nine primitives. Leibnitz used primes to denote concepts. Masterman’s 
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semantic net [28] uses 100 primitives, while Schank [35] uses 11 primitives. A similar concept 
called semantic formulae was also advocated by Wilks [42]. 

The idea of using semantic tags to link a word and the object it denotes is closely related 
to the the concept of reference in linguistics [22]: “the relationship between word and object is 
called the relationship of reference”. In fact, in linguistics, the meaning of a word is attempted 
to be equated with the relationship of reference {extensionalism). 

The following gives a partial list of semantic tags, taken from Beaugrande [5]: 

1. object: conceptual entities with a stable identity and constitution 

2. situation: configurations of mutually present objects in their current states 

3. event: occurrences which change a situation or a state within a situation 

4. action: events intentionally brought about by an agent 

5. state: the temporary, rather than characteristic, condition of an entity 

6. relation: a residual category for incidental, detailed relationships like ‘father-child’, ‘boss- 
employee’, etc. 

7. location: spatial position of an entity 

8. time: temporal position of a situation, state or event 

9. motion: change of location 

10. instrument: a non-intentional object providing the means for an event 

11. form: shape, contour, and the like 

12. substance: materials from which an entity is composed 

13. containment: the location of one entity inside another but not as a part or substance 

14. perception: operations through sensory organs 

15. cognition: storing, organizing, and using knowledge by sensorially endowed entity 

16. emotion: an experientially or evaluatively non-neutral state of a sensorially endowed 
entity 
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17. volition: activity of will or desire by a sensorially endowed entity 

18. recognition: successful match between perception and prior cognition 

19. communication: activity of expressing and transmitting cognitions by a sensorially en- 
dowed entity 

20. possession: relationship in which a sensorially endowed entity is believed (or believes 
itself) to own and control an entity 

21. quantity: a concept of number, extent, scale, or measurement 

22. value: assignment of the worth of an entity in terms of other entities 

Most of these concept types are familiar from case grammar that undertook to classify 
language relationships according to the organization of events and situations [15, 16]. 

The troubles occurring with the usage of semantic tags are: [36] 

• A universal set of primitives is yet to be identified. 

• Finer shades of meaning among a family of synonyms can cause trouble. 

• Grain of classification depends on application. 

Yet the approach is simple and eflfective, when the lexicon is carefully designed. 

4.5 Ambiguity Preservation 

A crucial trick used by ANGLABHARTI is to transfer the ambiguity over the target languages, 
whenever that is possible. For example, consider the sentence [24] 

“the quarrelsome Arabs want another war” 

This may be translated into Tamil as 

“kObakkAra arAb JcArargal matrum oru sandai kEtkirArgal . 

In both cases, there is an ambiguity, rending two readings; 

1. The Arabs want another war and they are quarrelsome 

2. Only those Arabs who are quarrelsome wish to fight again 

Clearly the decision whether to disambiguate or not in such cases should be present in the 
appropriate pattern in rule base. 

Subsequent chapters discuss how ambiguity resolution is carried out in speafic cases. 



Chapter 5 


On disambiguating verb senses in 
English 

5.1 Multiple verb senses 

Typically, any verb encountered in English has more than one sense. In any NLP system, it 
becomes essential to find the correct sense of usage, depending on the sentence and its context. 
During MT, different senses of a verb can have different equivalents in the target language. 
For instance, the English verb ‘bark’ as in “dogs bark” is equivalent to ‘kuraithal’ in Tamil, 
whereas the same verb as in “he barked his shins against some stone steps” is equivalent to 
‘sirAithukkJkolludal’ in Tamil. 

The present chapter deals with resolving the multiple senses of a verb in a sentence by simple 
techniques like checking its syntactic attributes, eg. whether it is transitive/intransitive, and 
by observing the semantic tags attached to the nouns surrounding it. 

5.2 Disambiguating with syntactic attributes 

One can often find the sense of a verb by observing the syntactic usage of each of its senses. 
Consider the verb ‘navigate’ which has the following senses:- 

1. Intransitive verb, find the position and plot the course of a ship, an aircraft, a car, etc. 
using maps and instruments. 

Which officer in the ship navigates? 

I’ll drive the car: you navigate, i.e. tell me which way to go. 

2. Transitive- verb - noun / Transitive-verb - noun - prepositional-phrase: 
steer(a ship); pilot an aircraft; 
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Navigate the tanker round the Cape. 

(figurative) Navigate a Bill through Parliament 

Any good dictionary gives valuable dues about the syntactic usages of different senses of a 
verb, which can be immediately harnessed. 

5-3 Disambiguating with verb patterns 

Many usages of verb has a fixed pattern. By recognising this pattern, the sense can be decided. 
This is especially true of idioms and phrasal verbs. 

This is illustrated with the usage of verb ‘put’: (sb: somebody sth: something) 

• put sth about: 

spread or circulate (false news, rumours, etc.) 

eg. he’s always putting about malidous rumours. 

it’s being put about that the Prime Minister may resign. 

• put sth across sb: 

trick sb into accepting a claim, etc that is worthless or untrue, 
eg. Are you trying to put one across me? 

• put oneself/sth across/over (to sb): 

communicate or convey (one’s personality, an idea, etc) to sb 
eg. He doesn’t know how to put himself across at interviews, 
she’s very good at putting her ideas across. 

• put sth at sth: 

calculate or estimate (the size, cost, etc of sth) to be (the specified weight, amount, etc) 
eg. I would put his age at about sixty, 
what would you put the price of this car at? 

I’d put it at $15000. 

• put sb away: 

confine sb in a prison or mental hospital 

eg. He was put away for ten years for armed robbery. 

She went a bit odd and had to be put away. 
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It should be of interest to note that many of the senses can be resolved by such pattern 
analysis. 

5.4 Disambiguating with voices of the sentence 

When the above features fail to help, the voices of the sentence may help to disambiguate the 
sense involved. 

For eg. consider the ‘transitive-verb - noun’ usage of the verb ‘run’, 
in active voice: (among many other senses) cover (the specified distance) by running eg. Who 
was the first man to run a mile in under four minutes? 
in passive voice: cause a race to take place, 
eg. The Grand National will be run in spite of the bad weather. 

6.5 Disambiguating with semantic tags 

This is a much more powerful technique than the ones discussed. However, this is much fuzzier 
also. This requires an in-depth analysis of the usage of a verb sense before identifying the 
disambiguating rules. 

In this method, we identify the nature of the subjects and objects involved with their real- 
world usage. Typically cryptic semantic primitives are kept in the lexicon with the nouns. 
Using these semantic primitives, the sense of a verb can be resolved. 

Consider the different senses of the verb ‘fall’: 

1. come or go down from force of weight, loss of balance, etc.; descend or drop, 
eg. The rain was falling steadily 

The leaves fall in autumn 

He slipped and fell ten feet 

That parcel contains glass - don’t let it fall 

The book fell off the table onto the floor 

He fell into the river 

I need a new bicycle lamp - my old one fell off and broke 
RULE: Subject is a physical-object 

2. hang down 

eg. Her hair fell over her shoulders in a mass of curls 
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His beard fell to his chest 

RULE; Subject is a physical-object, fixed-at-one-end 

3. decrease in number, amount or intensity 
eg. Prices fell on the stock market 

Her spirits fell at the bad news 
Her voice fell as they entered the room 
The temperature fell sharply in the night 
RULE: Subject: quantifiable. 

4. lose one’s power, office or position; be defeated 
eg. The Government fell after the revolution 
RULE: Subject; officer-bearer 

5. die in battle; be shot 

eg. Half the regiment fell before the enemy onslaught 
Six tigers fell to his rifle 

RULE; Prepositional-phrase; gun and Subject: animate 

6. (of a fortress, city etc) be captured 
eg. Troy finally fell to the Greeks 
RULE: Subject; PLACE 

7. happen or occur; has as a date 
eg. Easter falls early this year 
Christmas day falls on Monday 
RULE; Subject: event 

8. be spoken 

eg. Not a word fell from his lips 
RULE: Subject: speech 

Thus this method essentially involves a linguist’s conclusion about the nature of the phrases 
involved in the sentence. The grain of semantic tags required clearly depends on how dose two 
related senses are. 
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5.6 Defects of sense disambiguator in ANGLABHARTI 

1 . By and large, this is an ad-hoc scheme. Whenever the rules for disambiguation are found 
to be inadequate, they must be revised. 

2. Being a shallow approach, this may not be used for a rigorous understanding of the 
senses. There may be cases where the senses cannot be disambiguated by merely the 
above techniques. 

3. This involves considerable Human Engineering. All the rules for disambiguation must be 
manually identified and put in the lexicon. 

4. Considerable skill is required for the identification of semantic tags. A brute force method 
of assigning semantic tags can cause enormous growth in the number of tags to be 
produced. 

5.7 Merits of sense disambiguator in ANGLABHARTI 

1. Being a simple technique, this is a readily computationally feasible approach. Especially 
this is true when the domain of text is known a priori. 

2. Data for disambiguation is readily available from a good dictionary. 

3. Due its sole dependence on syntactic entities like noun-phrases and prepositional-phrases, 
the disambiguator module can readily use the parser output. 

4. ANGLABHARTI envisages post-editing. Therefore the method suggests itself provided 
the alternatives generated are not very high. 



Chapter 6 


Disambiguating Adjectives using 
Selectional Restrictions 

6.1 Word Sense ambiguity of Adjectives 

Typically adjectives have multiple senses, usually determined by the context of their usage. 
For instance, the adjective ‘green’ has at least 8 different senses. In any MT system, before the 
pr<q>er translation can be generated, it is essential to find the appropriate sense of an adjective 
present in the sentence. ANGLABHARTI tackles the situation in the sense disambiguator 
module, in the same vein as it does for verbs. Essentially, by observing the other adjectives or 
noun that follows, using the semantic tags attached to them, an attempt is made to find out 
the proper sense. 

Note that an adjective is related with other adjectives and the noun that it modifies by 
rule base. As an example, “noun is adj” pattern connects the adjective with the subject. It 
is true that not always such a relationship is uniquely determined by ANGLABHARTI. Where 
required, multiple associations of adjectives are permitted. A human engineered post-editor is 
assigned the task of chosing the proper output. 

As in the case of verbs, disambiguation of adjectives requires a proper analysis of their 
usages, which is then encoded in the lexicon. 

6.2 Selectional Restrictions of Adjectives 

While essentially the same approach used for disambiguating senses of any word in general (viz. 
using patterns, syntactic characteristics etc. [Section 4.3]) can be applied here, ANGLAB- 
HARTI uses only the semantic tags in this process. This is because, it is believed that, they aire 
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the tools most useful in this case. Future versions of ANGLABHARTI may use other approaches 
as well. 

The following gives an illustration of the approach used: 

• competent 

1. having the necessary ability, authority, skill, knowledge, etc. 

eg. a highly competent driver; he is not competent to look after young children 
noun: human 

2. quite good but not excellent 

eg. the novel may be a best seller, but it’s no more than a competent piece of 
writing; ^ 

a competent piece of work 
noun: work 

• green 

1. of the color between blue and yellow in the spectrum 
eg. fresh green peas 

noun: physical-object 

2. covered with grass or other plants 
eg. green fields, hills, etc. 

noun: geological-object 

3. not yet ripe 

eg. green bananas; apples too green to eat 
noun: fruit 

4. not yet dry enough for use 

eg. green wood does not burn well 
noun: wood 

5. immature; inexperienced; easily fooled 

eg. a green young novice; you must be green to believe that 
noun: human 


• plain 
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1. easy to see, hear or understand; clear 

eg. the markings along the route are quite plain; in plain English; He made it plain 
to us that he did not wish to continue; she made her annoyance plain, 
noun: abstract-idea or communication 

2. not decorated or luxurious; ordinary and simple 

eg. a plain but very elegant dress; a plain food/cooking; plain cake 
noun: product 

3. not beautiful or good looking 

eg. a few rather plain bits of furniture 

from a rather plain child, she had grown into a beautiful woman 
noun: human or physical-object 

• replete 

1. well-fed or full; gorged 

eg. lions replete with their kill; feel replete after a large meal 
noun: human or animal 

2. well stocked or supplied 

eg. a house replete with every modern convenience 
noun: default 

* serious 

1. solemn and thoughtful; not frivolous 
eg. a serious person, mind, appearance 

her face was serious as she told us the bad news 
he seems very serious, but in fact he has a delightful sense of humour 
please be serious for a minute, this is very important 
noun: default 

2. intended to provoke thought; not merely for amusement 
eg. a serious essay about social problems 

do you ever read serious works? 
noun: work 
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3. important because of possible danger or risk; grave 
eg. a serious illness, mistake, accident 
a serious decision about giving up a steady job 
that could cause serious injury 
the international situation is extremely serious 
noun: unfavourable 

• vola.tiIe 

1. changing rapidly into vapour 
noun: liquid 

2. changing quickly from one mood or interest to another; fickle 

eg. a slightly volatile personality, disposition, nature, etc. noun: person or person- 
ality 

3. likely to change suddenly or sharply; unstable 

eg. volatile stock-markets, exchange rates; a volatile political situation 
noun: trade or state-of-affair 

6.3 Demerits of the Scheme 

The demerits of using semantic tags can be easily identified: 

1. ad-hoc scheme. By and large, this is an ad-hoc scheme, as no universal set of semantic 
primitives are yet identified. 

2. sufhcieacy. Clearly this is insufficient. A more general scheme involving other properties 
mentioned earlier is necessary to disambiguate all cases. 

3. difficult lexicon development. Clearly the lexicon should be built carefully after con- 
sidering all the cases. However, with the help of a good lexicon, this obstade can be 
minimised. 

A detailed analysis on the defects on relying on semantic tags alone for disambiguation and 
the various remedies thereof can be found in Tennant[37]. 
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6.4 Merits of the Scheme 

1. simplicity. The scheme is basically simple to implement. Surprisingly this seems to take 
care of majority of the cases in daily usage. 

2. no extra effort required. Semantic tags are already present in the lexicon for each noun, 
as this is required by the verb disambiguator. By using the existing information in the 
lejdcon for disambiguating adjectives, considerable effort is saved. 



Chapter 7 


Mapping Prepositions from English 
to Tamil 

7.1 Preposition Mapping 

During Machine Translation from English to Tamil, one ends up iinding the equivalent of the 
English prepositions in Tamil. The usual techniques involve a deep analysis of the sentence, 
to resolve the case roles played by the various phrases involved. However, a simpler scheme 
is suggested which is independent of other components in the sentence with a prepositional 
phrase. 

This chapter deals with prepositions of the form ‘noun-phrase preposition noun-phrase’. 
The suggestion is that by simply knowing the semantic tags attached to the head nouns on 
either side, one can map the prepositions from English to Tamil. 

It should be noted that English is a verb-central language while Tamil is a verb-final 
language. Hence the movement of prepositional phrases from English to Tamil is: preposition 
noun-phrase -»• noun-phrase’ preposition’. 

7.2 Mapping 

The mapping of prepositions is demonstrated henceforth. The following heuristics are arranged 
in the descending order of priority, for each preposition considered, ‘anything’ is a wild card, 
while ‘nil’ refers to absence of a noun-phrase, which is being modified by the preposition 
considered. Note that in the latter case, the mapping is bound to be erroneous in some cases, 
as the classification of the verb preceding the preposition is neglected, to simplify the matter. 
It is of interest to note that this arrangement enables invoking a default mapping for any 


preposition. 
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• on 

human on physical-body -iLulla 

eg. the people on the bus bus -iLulla makkal 

animal on physical-body —>■ -iLulla 

eg. the dog on the terrace mAdi -iLulla nAi 

nil on physical-body — > -il 

eg. the people were singing on the bus makkal bus -il pAdikkondirundArgal 
he sat on the chair —>■ avan nArkAli -il utkArndAn 
nil on time — * -andru 

eg. on TNiesday, I came — + Tuesday -andru nAn vandEn 
event on anything -+ -ai.patri 

eg. the course on English grammar -+ English ilakkanam -ai_patri pAdam 

• in 

nil in anything — > -il 

eg. in the afternoon, we went to Boston — *• mAlai -il (we went to Boston)’ 
the load arrived in March —>■ sarakku March -il vandu Jrangiyadu 
in a grave manner — > (grave manner)’ -il 

• to 

nil to place -+ -ikku 

eg. we went to his house — »• nAngaJ avan vidu -ikku pOnOm 

my house is next to yours —>■ enadu vIdu ungaJudaiyadu -ikku aduttu uUadu 

(Note that semantic tag for ‘yours’ is borrowed from that for the head noun of the subject 

‘my house’) 

• at 

nil at physical-body -»• -ai 

eg. we were looking at his awful paintings 

nAngal avanadu mOsamAna Oviyangal -ai pArthukkondirundOm 
nil at human -+ -midu 

eg. he was surprised at her — *■ avan aval -mIdu AcharyappattAn 
nil at action -* -midu 
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eg. the public were shocked at his murder — + avanaxiu kolai -midu makkal vagundArgal 

• near 

nil near anything -+ -arugE 

eg. the man went near the club -+ manidan club -arugE chenrAn 

human near anything -»■ -arugEa-ulla 

eg. the man near the table table -arugE-ulla manidan 

• for 

anything for time — > -ikku 

eg. he is expected for several weeks — > avan pala vArangaJ -ikku ethirpArkkappadugirAn 

their arrival for a month — *■ oru mAsam -ikku avargaladu varugai 
anything for anything — »• -ikkAga 

eg. I worked for success nAn vatri -ikkAga uzhaikkirEn 
her friendship for Chopin Chopin -ikkAga avaladu natpu 

• during 

nil during time — <■ -pozhudu eg. they worked during the vacation — » avargal lIvu_nAtkal 
-pozhudu vElai-saidArgaJ 

• of 

anything of abstract-idea — »■ -ai_patri 

eg. he convinced her of the need avan avallukku tEvai -ai_patri puriya_vaithAn 

(Note: ‘of the need’ does not modify ‘her’) 

the news of her success -+ avaladu vetri -ai.patri saidi 

event of human -* -udaiya 

eg. the arrival of his daughter — * avanadu magal -udaiya varugai 

an opera of Verdi’s Verdi -udaiya oru opera 

place of place -* nil 

eg. the city of Rome — >■ Rome nagaram 

anything of anything -in 

eg. guard of the house — >• vidu -in kAvaUcAran 



the king of Spain — + Spain -in arasan 

the day of her arrival — ♦ avaladu varugai -in dinam 

the enthusiastic reception of the play —* nAdagam -in urchAga varavErpu 

• before 

time before event -ikkujmudal 

eg. the day before her arrival — ♦ avaladu varugi -ikku jnudal dinam 

• between 

anything between anything — + -ikkuJdaiyil 

eg. she came between 2’0 clock and 3’0 clock -»■ 
aval 2 mani matrum 3 mani -ikkuJdaiyil vandAl 

• from 

event from place — » -ilJrundu 

eg. the departure from Hamburg -»• Hamburg -ilJrundu purappAdu 

• behind 

nil behind physical-body —* -in_pinnE 

eg. behind the bus — ♦ bus -in.pinnE 

anything behind physical-body -in_pinnE_ulla 

eg. the children behind the fence -»• vEli -in_pinnE_ulla 

• over 

human over physical-body -mldu_ulla 

eg. the man over the bridge bridge -mldu_ulla manidan 

anything over anything — » -midu 

eg. the quarrel over pay — > sambalam -mIdu sandai 

• by 

nil by anything — > -A1 

eg. they were welcomed by the hosts — > avargal hosts -A1 varavErkkappattanar 

anything by anything -in 

eg. work by the artists —>■ kalaigyargal -in vElai 
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It is hoped that further addition of such transformation rules can improve the quality of 
Tamil text generator in AN GLAB MARTI. 



Chapter 8 

A Template-Driven Morphological 
Derivation for Verbs in Tamil 

8.1 Verb Variations 

ANGLABHARTI uses a rule base which converts sentences from English into an intermediate 
form, which is then fed to the text generator modules for different target language. The text 
generator routine derives the appropriate form of the target word from the root word and the 
other information provided. 

The present chapter deals with deriving the variations of a verb in Tamil from its root, 
which can be used by a text generator as above for Tamil. The paradigm envisaged here is 
to use the idea of verb-templates and verb-classes. A verb-template is the part pertaining to 
verbs in the intermediate form generated from the rule base. For example, [has-already-been- 
verbjng-form] is a template. A verb class refers to a group of verb roots in Tamil, which 
behave in the same way during morphological derivation. For example, ‘vaithiru’ and ‘iru’ are 
two such verb roots in Tamil that have similar suffixes during variations under tense, gender, 
number, person etc. 

By constructing rules for a given template and a given class and by classifying the existing 
verbs in Tamil into different classes, one gets a neat scheme to derive the variations of verb, 
which can be used for a text generator as discussed earlier. 

The idea is elaborated in the subsequent sections. 

8 .2 Verb Templates 

Five morphological variations of a verb in English is observed. Labeling them suitably, we 
have 


.18 
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verb-1: eat form (eat, walk, come, run etc.) 
verb-2: eats form (eats, walks, comes, runs etc.) 
verb-3: ate form (ate, walked, came, ran etc.) 
verb-4: eaten form (eaten, walked, come, run etc.) 
verb-5: eating form (eating, walking, coming, running etc) 

We have modal-words like ‘must’, ‘can’, ‘may be’ etc. In addition, there are auxiliaries 
‘am’, ‘is’, ‘were’ etc. Infinitives are preceded by the word ’to’. Negatives are typically denoted 
by the word ’not’. 

Armed with this classification, one can easily identify the different templates for the occur- 
rence of a verb phrase in English. The following gives a sample: 
verb-3(): walked, worked, helped 
verb-l(): walk, work, help 

am-verb-5(): am walking, am working, am helping 
does- verb- 1(): does walk, does work, does help 

is-a.lrea^y-verb-5(): is already walking, is already working, is already helping 

hope- to- verb- 1(): hope to walk, hope to work, hope to help 

might- have- verb-4(): might have walked, might have worked, might have helped 

shouId-not-verb-l(): should not walk, should not work, should not help 

wil]-not-verb-l(): will not walk, will not work, will not help 

was-verb-3(): was helped 

Now such a template with the gender, number, person of the subject and the root verb in 
the target language provides all the details necessary to find the appropriate verb that should 
appear in the output stream of ANGLABHARTI. 

It should be noted that in addition, minor changes may be required. For example, when 
the verb- phrase is used in an imperative sentence as in “go to school”, the gender, number 
and person parameters hold no significance. This detail must be conveyed to the module that 
derives the target verb. 

In ANGLABHARTI, about 50 such templates of verb- phrases are identified. 

8.3 Verb Clzisses 

As already mentioned, these are groups of roots that behave identically during morpholo^cal 
derivation. As many as 30 such classes axe identified for Tamil. The lexicon contains details 
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about the class of each verb. It should be noted that for a given verb class, there are as 
many rules for deriving suffixes as there are combinations of templates and gender, number 
and person of subject. 

The current version of ANGLABHARTI merely adds a suitable suffix to the verb-root. The 
future versions are expected to perform sandhi analysis, i.e. analysis of how the final letters of 
the verb- root get modified, while adding a suitable suffix. 

8.4 Demerits of the Scheme 

1. Too many (template - gender, number, person) combinations possible. 

2. Redundancy in templates. For instance, may-verb-l() form and casi-verb~l() form both 
behave similarly for Tamil, with respect to morphological derivation, eg. “may go” and 
“can go” both corresponds to ‘pOgalAm’. 

8.5 Merits of the Scheme 

1. Minimal analysis of verb phrases. This obviates the need to extract the tense and modal- 
ity information. 

2. Uniform approach to aJl target languages. A similar approach is used in the text gener- 
ators of Hindi and Telugu. 



Chapter 9 

Conclusion 


9.1 Current Implementation 

The current version of ANGLABHARTI uses Prolog platform to realise the rule base, the 
Sense Disambiguator and the Tamil Text Generator. However other activities like the human- 
engineering aspect, the preparation of on-line lexicon, Text Generators for Hindi and Telugu, 
etc. are done in the C Programming Language. Within a period of over a year, a workable 
version of ANGLABHARTI is available. 

9.2 Future Activities 

The following are some of the future activities envisaged: 

1. Lexicon Development A massive multi-lingual vocabulary involving English, Tamil, 
Hindi and Telugu is envisaged. 

2. Rule Base Augmentation. The rule base is to be augmented to cover more number of 
structures. 

3. Text Generation. The Text Generators for the different target languages is to be enlarged, 
by increasing the verb-classes. 

4. More Disambiguation. More number of categories is to be disambiguated, based on the 
principles already being used. 

5. Human Engineering. ANGLABHARTI is to be made more user-friendly. 

cents M. L'SRARV 

t < ■ o<JR 

4cc No. 
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Appendix A 


Sample Rule Base in 
ANGLABHARTI 


s_body(Op) — > 

noun.phrase(G, N, P, Tagl, A), 

verb_phrase(normal, G, N, P, Voice, Vmles, B), prep_phrase([‘NIL’], Ptag, C), 

{ Srules=[‘Ipr’], resolve(Vrules, Srules, Ptag, Voice, Tagl, [‘NIL’], [‘NIL’]), 
append(A, C, Tl), append(Tl, B, Op) } 

% I am going to the market 
% I was attacked by him 
% I was attacked by night 

I noun_phrase(G, N, P, _, Tagl, A), verb_phrase(normal, G, N, P, Voice, Vrules, B), 
prep_phrase([’NIL’], Ntag, Ptag, C), noun-phrase(_, ., _, ., Tag2, D), 

{ SruIes=[’Dnpr’], resolve(Vrules, Srules, Ptag, Voice, Tagl, Tag2, Ntag), append(A, D, Tl), 
append(Tl, C, T2), append(T2, B, Op) } 

% I gave to the boy a toy 
% the boy was given by me a toy 

I noun_phrase(_, singular, third, _, _, A), [is], noun_phrase(_, _, _, _, _, B), 

{ !, append(A, B, Op) } 

% she is my sister 

% we dread Mary/Mary’s taking over the business 
I [there, is, something], adv(B), [about], noun-phrase(_, _, _, _, C), 

{ append(C, [11], Tl), append(Tl, [19], T2), append(T2, B, T3), append(T3, [vl]. Op) } 

% there is something pleasing about him 
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1 question(A), [is], iioun.phrase(G, singular, third, ., ., B), 

{ is.verb(G, V), append(B, A, Tl), append(Tl, V, Op) } 

% where is the girl 
and so on 

option.l -+ [that] [ [ ]. 

restjsame(Xl, Op) —>■ [and], sentence(mor€, X), { append(Xl, [13], Tl), append(Tl, X, Op) }. 
restjrev(Xl, Op) -» 

[after], sentence(more, X), { append(X, [17], Tl), append(Tl, XI, Op) } 

I [when], sent€nce(more, X), { append(X, [18], Tl), append(Tl, XI, Op) } 

1 [because], sentence(more, X), { append(X, [12], Tl), append(Tl, XI, Op) } 
j [since], sentence(more, X), { append(X, [15], Tl), append(Tl, XI, Op) }. 
sentence{Level, Op) -+ s_body(Opl), rest(Level, Opl, Op). 
rest(Level, X, Op) 

[ ], { Level=more, Op=X } 

1 [W], { lastword(W), Level=one, app€nd(X, [W], Op) } 

I rest.same(X, XI), rest(Level, XI, Op) 

I restjrev(X, XI), rest(Level, XI, Op). 



Appendix B 


Sample Rule Base for Nouns in 

ANGLABHARTI 


noun_body(G, N, P, Tag, X) 

POS_case(A), det_star(B), noun(G, N, P, Tag, C), { append(A, B, Tl), append(Tl, C, X), ! } 
% his two bags 

1 verb_5(noun, normal, G, N, P, _, A), adv(B), { append(B, A, X) } 

% eating greedily 

1 verb.5(noun, normal, G, N, P, X) 

1 adv(A), verb.5(noun, normal, G, N, P, B), { append(A, B, X) } 

I det_star{A), adjjBtar(B), noun(G, N, P, Tag, C), { append(A, B, Tl), append(Tl, C, X) }. 
% the great man 

restjni^ame(Vl, Gl, Nl, PI, G, N, P, Op) -»■ 

[whose], sentence(more, A), 

{ append([‘enda’], VI, Tl), append(Tl, [‘-udaiya’j, T2), 
append(T2, A, T3), append(T3, [‘-O’j, T4), 

append(T4, [‘anda’j, T5), append(T5, VI, Op), G=G1, N=N1, P=P1 } 

% enda noun -udaiya sentence -0 anda noun 
1 [which], s_minus_npl(A), 

{ Gl=neuter, append(A, VI, Op), G=G1, N=N1, P=P1 } 

% s_minus-npl NP 

I [‘, ’], { Vl=0p, G=G1, N=N1, P=P1 } 

1 [who], sjminusjapl(A), 

{ not(Gl=neuter), append(A, VI, Op), G=G1, N=N1, P=P1 } 
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% s_minus_npl NP 

I [and], noun_phrase(_, A), { append(Vl, [13], Tl), append(Tl, A, Op), 

G=dont_care, N=plural, P=third } 

I [‘, ’], noun_phrase(-, _, _, ., ., A), { append(Vl, [‘, ’], Tl), append(Tl, A, Op), G=dont_care, 
N=plural, P=third } 

1 [or], noun_phrase(G, N, P, _, _, A), { append(Vl, [14], Tl), append(Tl, A, Op) }. 
restja_rev(Tag, A_tag, A.tagl, VI, Op) -+ 

prep_phrase(Tag, ., Ptag, X), { append(X, VI, Op), append(A.tag, Ptag, A_tagl) } 

1 verb_5(nonJinite, normal, _, _, _, _, A), prep _phrase( [‘NIL’], _, _, B), 

{ A_tagl=A_tag, append(B, A, Tl), append(Tl, VI, Op) }. 
noun_phras€(G, N, P, AlLtag, Tag, Op) -»■ 

noun.body(Gl, Nl, PI, Tag, XI), restJi(Tag, Tag, All.tag, XI, Gl, Nl, PI, G, N, P, Op). 
rest_n(Tag, A.tag, AlLtag, VI, Gl, Nl, PI, G, N, P, Op) 

[ ], { G=G1, N=N1, P=P1, Op=Vl, AlLtag=A.tag } 

I rest_n^ame(Vl, Gl, Nl, PI, G2, N2, P2, XI), rest_n(Tag, A.tag, All.tag, XI, G2, N2, P2, 
G, N, P, Op) 

1 restjijrev(Tag, A.tag, A.tagl, VI, XI), restji(Tag, A_tagl, AlLtag, XI, Gl, Nl, PI, G, N, 
P, Op). 



Appendix C 


Sample Rule Base fqr Verbs in 
ANGLABHARTI 

v_body(Type, G, N, P, Voice, Vrules, X) — > 
verb_3(Type, normal, G, N, P, Vrules, X), { Voice=‘active’ } 

1 verb_l(Type, normal, G, N, P, Vrules, X) , { Voice=‘active’ } 

I verb-2(Type, normal, G, N, P, Vrules, X), { Voice= ‘active’ } 

1 [am], verb.5(Type, am, G, N, P, Vrules, X) , { Voice= ‘active’ } 

I [can], verb_l(Type, can, G, N, P, Vrules, X), { Voice= ‘active’ } 

I [had, been], verb_5(Type, had-been, G, N, P, Vrules, X) , {Voice=‘active’ } 

I [hope, to], verb-lCPype, hope_to, G, N, P, Vrules, X), { Voice= ‘active’ } 

I [is, going, to], V€rb_l(Type, is^oingJo, G, N, P, Vrules, X) , { Voice= ‘active’ } 

I [might, have], verb.4(Type, mightJiave, G, N, P, Vrules, X) , { Voice= ‘active’ } 
r€St_v-same(Type, VI, G, N, P, Op) [and], verb-phrase(Type, G, N, P, A), { append(Vl, 
13, Tl), append(Tl, A, Op) }. 

rest_v_rev(_, VI, _, _, _, Op) adv(X), { append(X, VI, Op) }. 
v_prefix(X) ■{ X=[] } 

I adv(X). 

verb_phrase(Type, G, N, P, Voice, Vrules, Op) v_preiix(X), v_body(Type, G, N, P, Voice, 
Vrules, XI), 

{ append(X, XI, X2) }, rest_v(Type, X2, G, N, P, Op). 
rest_v(Type, VI, G, N, P, Op) -»■[],{ Op=Vl} 

I rest_v_same(Type, VI, G, N, P, Op) 

I rest_v_iev(_, VI, _, _, _, Op). 
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Appendix D 

Suffixes for Verb Roots in Tamil 


vsuffix(‘adai’,one,normal, normal, dont-care, singular ,first,[‘kkirEn’]). 
vsuffix(‘pidi’, one, normal, can, dont.care, singular, first, [‘kka_vallavan’]). 
vsuffix(‘pidi’,three,normal,normal,neuter,singular,third,[‘tliadu’ ]). 
vsuffix(‘pidi’,three,normal,normal,dont_care,plural,third,[‘ttArgal’]). 
vsuffix(‘sAppidu’,one, normal ,normal,neuter,plural,third,[‘girana’]). 
vsuffix(‘sAppidu’,one, command, never ,dont_care,dont_care,dont_care,[‘Ade’]). 
vsuffix( ‘sAppidu’, two, non_finite, normal, dont-care, dont_caxe,dont_caje,[‘ginra’ ] ) . 
vsnffix(‘8Appidu’,five,noun,normal,neuter, singular, tliird,[‘vadu’]). 
vsuffix(‘sAppidu’,tliree,normal,normal,dont_care,singular,second,[‘ittAi’ ]). 
vsuifix(‘pO’,one,normal,normal,dont_care,plural,tliird,[‘©rArgal’]). 

vsuffix( ‘pO ’ ,three, normal ,normal ,dont-care,plural,third,[‘n Argal ’] ). 
vsuffix(‘pO’,five,normal,am,dont_care, singular ,first,[‘girEn’]). 
vsuffix(‘pO’,five,normal,is,neuter,singular,tliird,[‘pradu’]). 
vsuffix(‘iru’,one,normal,normal,feminine,singular,third,[‘kkirAl’]). 
vsuffix(‘iru’,one,normal ,normal,masculine,singular,third,I‘kkir An’] ). 

vsuffix(‘iru’,one,normal,normal,neu ter, singular ,third,[ kkiradu ]). 
vsufiix(‘iru’,two,normal,normal,neuter, singular ,third,[ kkiradu ]). 
vsuffix(‘iru’,thre€,normal,normal,feminine,singular,tlurd,[ ndAl ]). 
vsulRx(‘iru’,three,normal,normal,masculine,singular,third,[‘ndAn’]). 
vsujBix(‘pAr’,one,non-finite,normal,dont_care,dont.care,dont-care,[‘kka’]). 
vsufiix(‘pAr’,two,nonJinite,normal,dont_care,dont-care,dont_care,[ kkinra ]). 
vsuffix(‘pAr’, three, normal,normal,dont_care,singular, first, [‘thEn’]). 

vsuffix(‘pAr’,four,non_finite,have_been,dont.care,dont_care,dont_caxe,[‘kkappattadAga’]). 
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V8uffix( ‘vAzh’jOne, non Jinite, normal, dont. care, dont_care,doiit_caxe, [‘a’]). 
v6uffix(‘pEsu’,two, normal, normal, masculine, singular, third, [‘girAn’ ]). 
v8uffix(*vA’,three,normal,normal,dont_care,singular,first,[‘andEn’]). 
vsuffix(‘utkAr’,three,normal, normal ,masculin€, singular ,third,[‘ndAn’]). 
vsuffix(‘sol’,three,normaJ,normal,masculine,singular,third,[‘nnAn’]). 
vsuffix(‘sor,three,normal,normal,dont_care,singular, first, [‘nnEn’ ]). 
vsuffix(‘anuppu’,three,normal,were,dont_care,pluraI,third,[ ‘ap_pattanar’ ]). 
vsufiix(‘anuppu’,three,normal,was,masculine,singular,third,[‘ap_pattAn’]). 
vsuffix( ‘anuppu ’ ,three, normal ,was ,feminine, singular, third ,[‘ap _patt A1 ’] ) . 
vsufRx(‘anuppu’,three,normal,was,neuter,singular,third,[‘ap_pattadu’]). 
vsulRx(‘anuppu’,three,normal,normal,masculine,singular,third,[‘inAn’]). 
vsuffix( ‘anuppu ’, three ,normal ,normal ,neuter,singular, third , [‘iyadu’] ) . 
vsuffix(‘vA’,three,normaJ,normal,dont.care,singular,second,[ ‘andAi’ ]). 
vsufRx(‘kodu’,three,normal,normal,feminine,singular,third,[‘thAl’]). 
vsufRx(‘kEl’,three,normal,normal,feminine,singular,third,[‘ttAl’]). 
vsulfix(‘Odu’,three,normal,normal,feminine,singular, third, [ ‘inAl’ ]). 
vsufRx(‘Odu’,three,normal,normal,masculine,singular,third,[ ‘inAn’ ]). 
vsuffix( ‘sai ’,three,normal, normal,feminine,singular, third ,[‘dAl’] ). 
vsuffix(‘Agu’,thre€,non_finite,normal,dont_care,dont_care,dont_care,[ ‘iya’ ]). 
vsuffix( ‘kurai ’,thr€e,normal,normal,neuter ,singular,third,[‘thadu’] ) . 
vsuffix(‘kurai’,three,normal,normal,masculine,singular,third,[‘thAn’]). 
vsuffix(‘kurai’,three,normal,normal,feminine,singular,third,[‘thAl’]). 
vsuffix(‘kathu’,three,normal,normal,masculine,singular,third,[‘inAn’]). 
vsuffix(‘thirudu’,four,normal,was,neuter,singular,third,[‘appattadu’]). 
vsulfix(‘nir,five,nonJinite,normal,dont.care,dont_care,dont_care,[‘irkinra’]). 
vsuffix(‘thiri’,three, normal,normal,dont_care,plural,third,[ ‘ndanar’ ]). 
vsulRx(‘thiri’,thre€, normal, normal,neuter,singular,third,[ ‘ndadu’ ]). 
vsuffix(‘thiri’,three, normal, normalpnasculine,singular,third,[ ‘ndAn’ ]). 
vsuffix(‘thiri’,three, normal,normal,feminine,singular,third,[ ‘iidAl’ ]). 
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Appendix F 


Sample Interaction with 
ANGLABHARTI 


SWITCHED OVER TO DEMO MODE 


your sentence 
i 2un going to the marhet . 
nAn kadai -ikku pOgirEn . 

your sentence 

i came by bus . 

nAn Urthi -Al/-il vandEn . 

your sentence 
pigeons eat worms . 

purAkkal puzhukkal -ai/-NULL/-irkku/enru sAppidugirana . 

your sentence 

they wandered-about in sheepskins and goatskins . 

avargal sheepskins matzum Attu.thOlgal -il sutri.thirindanar 


yo\ir sentence 

she is beautiful ! 

aval azhagAga irukkirAl ! 
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your sentence 

the lady , vhose baig was stolen , was furious . 

enda pen -udiaya pai thirudappattadu -0 anda pen kObamAga irundAl 

your sentence 

the beautiful dog quickly bit the man . 

azhagAna nAi manidan -ai/“NULL/-irkku/enru vEgamAga kadithadu . 

your sentence 

he sat at his desk . 

avan avanadu mEjai -il utkArndAn . 

your sentence 

it is in the desk-drawer . 

adu mEjaiyin_drawer -il irukkiradu . 

your sentence 

that desk is dusty . 

anda mEjai azhukkAga irukkiradu . 

your sentence 
where is the desk ? 
mEjai engE irukkiradu ? 

your sentence 
i saw the tall man . 

nAn uyaramAna manidan -ai/-NULL/-irkku/enru pArthEn . 

your sentence 
the poor go away ! 

Ezhai_makkal dUramAga pOgirArgal ! 



your sentence 
i can fish . 

nAn min -ai/-NULL/-irkku/enru bOttilil.adaikkirEn . 

nAn mIn_pid<iikka_veJ.lavan . 

your sentence 

the rich vent avay ! 

panakkAra_makkal dUramAga pOnArgal ! 

your sentence 

the rich man talks proudly ! 
panakkAra manidan garvathOdu pEsugirAn ! 

your sentence 
he is in the house . 
avan vidu -il irukkirAn . 

your sentence 

he is in school . 

avan pallikUdam -il irukkirAn . 

your sentence 

there is something pleasing about him ! 

avan -ai patri Edo onru sandOsham_alikkakUdiya_vagaiyil irukkiradu 

your sentence 

the girl gave the boy a toy . 

pen paiyan -ai/-ikku oru bommai -ai/-NULL/-irkku/enru kodiithAl . 
your sentence 

the girl asked the boy a toy . 



pen paiyan ~ai/-ikku oru bommai “ai/-NULL/-irkku/enru kEttAl . 


your sentence 

the girl gave a toy to the boy . 

pen paiyan -ikku oru bommai -ai/-NULL/-irkku/enru koduthAl . 

your sentence 

the room has a large windon , which laces south . 
arai therku -ai/-NULL/-irkku/enru pArkkinra oru periya jannal 
-ai/-NULL/-irkku/enru kondirukku . 
arai pArkkinra oru periya jannal 

~ai/~ikku therku -ai/-NULL/-irkku/enru kondirukku . 
arai pArkkinra oru periya jannal 

-ai/-ikku therku -ai/-NULL/-irkku/eniu kondirukku . 

your sentence 

the bus , which runs south , is going to the market . 

therku -ai/-NULL/-irkku/enru Oduginra Urthi kadai -ikku pOgiradu . 

therku -ai/-NULL/-irkku/enru Oduginra Urthi kadai -ikku pOgiradu . 

your sentence 

the tall girl standing in the comer , who became angry 
because you knocked-over her glass , when you entered , 
is my sister . 

nl ullE.vandAi appOdu nl avaladu tumbler 

-ai/-NULL/-irkku/enru thalli.vittAi Enra kAreuiathAl kObamAga Ana 
Oram -il nirkinra uyaramAna pen enadu akkA . 

your sentence 
i told her to see him . 

avan -ai/-NULL/-irkku/enru pArkka nAn aval -ai/-NULL/-irkku/enru kUrinen 



your sentence 

he eas believed to have been seen by her . 
aval -Al/-il pArkhappattadAga avan nambappattAn . 

your sentence 

the man said she is beautiful . 

aval azhagAga irukkirAl enru manidan kUrinAn - 

your sentence 

he , his tvo brothers , and sister were sent to live for three years 
with their grandmother in the hut near the river . 
nadi -arugE kudisai -il avargaladu pAtti -udan_kUdiya/-udan 

mUnru varudangal -ikku vAzha avan , avanadu irandu aiman.thambimArgal 
matrum akkA anuppap.pattaneo: . 

your sentence 

they proved that he was wrong . 

anda avan thavarAga irundAn enru avargal nirUbittArgal . 

avan thavarAga irundAn enru avargal nirUbittArgal . 

your sentence 
away ran he ! 
dUramAga OdinAn avan ! 

your sentence 

eating greedily is bad manners . 
pErAsai.yOdu sAppiduvadu ketta pazhakkam . 

your sentence 

the sun keeps us very warm . 
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sUriyan nAm -ai/-NULL/-irkku/enru migavun idamAga vaithirukkiradu . 

your sentence 

never call a man a fool . 

oru manidan -aiZ-ikku oru muttAl -ai/-HULL/-irkku/enru eppOdumE kUppidAde . 

your sentence 

i came to the top floor of a house 
in the comer of the old square 
behind the church . 

nAn mAdA_kOil -in_pinnE pazhaiya saduram/sandippu 
-in/-ai_patriya Oram -il oru vidu -in/-ai_patriya 
inRl tharai/mAdi -ikku vandEn . 


your sentence 

SWITCHED OVER TO INTERACTIVE MODE- 


Please try again 


yes 



